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Abstract 

Clustering and correlation effects are frequently observed in chaotic 
systems in situations where, because of the positivity of the Lyapunov 
exponents, no dimension reduction is to be expected. In this paper, 
using a globally coupled network of Bernoulli units, one finds a gen- 
eral mechanism by which strong correlations and slow structures are 
obtained at the synchronization edge. A structure index is defined, 
which diverges at the transition points. Some conclusions are drawn 
concerning the construction of an ergodic theory of self-organization. 

1 Introduction 

Even simple one degree of freedom systems may display a rich dynamical 
behavior, namely, sensitive dependence to initial conditions (chaos), peri- 
odic and aperiodic orbits of all types, mixing properties, etc. When these 
systems are coupled, their cooperative behavior reveals a set of dynamical 
patterns of which the most interesting ones are clustering, coherent structures 
and synchronization. The cooperative effects of simple coupled systems and 
their dependence on the intensity of the coupling seem to provide the dy- 
namical basis for many phenomena in physics jl]] 0, chemistry |4| and the 
neurosciences[Q [0. It has also been suggested by several authors^] || 



1 



HJ that self- synchronized activity in insect colonies has adaptive advantages 
and is responsible for efficient task fulfillment. 

Synchronization of chaotic systems is a very interesting phenomenon that 
has been extensively studied 0] Jl2] and which, in addition to its role in mod- 
eling natural systems, may have technological applications, for example in 
the field of secure communications. According to the theory developed by 
Pecora and Carrol a subsystem synchronizes with another (chaotic) subsys- 
tem when the corresponding conditional Lyapunov exponents are negative. 
The conditional exponents being bona-fide ergodic invariants [|l3f| , this is a 
precise mathematical condition for synchronization on the support of the 
invariant measure where the exponents are defined. 

In the standard synchronization scenario, one of the chaotic subsystems 
enslaves the other and there is in an effective dimension reduction in phase- 
space. However it has been noticed by several authors that there are sit- 
uations where one obtains synchronization even with positive conditional 
exponents (T^ and clustering or strong correlations of the subsystems even 
when they are desynchronized fT5[| fT6|j ||17|| . These correlations have been 
called hidden coherence. Synchronization with positive conditional exponents 
has been attributed to the extreme trap effect [H], namely the fact that near 
an extreme point of the iteration function the linear terms vanish and second 
order terms may have an effective contracting role. On the other hand fluc- 
tuations in the mean field felt by each individual subsystem and instability 
of the solutions for an effective one-dimensional Perron- Frobenius equation, 
have been proposed [18] as an explanation for the hidden coherence. These 
mechanisms may of course play a role in the formation of coherent structures 
and specific dynamical features must surely have to be taken into account 
for the concrete interpretation of each particular case. However one would 
like to understand why clustering and correlation effects are so common in 
coupled situations where naively we would still expect to have very small or 
no dimension reduction in the overall dynamics. 

The method to be used in this paper is also to study a concrete example 
but one that is sufficiently simple for almost everything to be exactly com- 
puted and from which essential features may be isolated from model details. 
In particular, by using piecewise linear maps one gets rid of second order ef- 
fects and non-uniform hyperbolicity. Also the fluctuations in the mean field, 
seen by each element of the coupled system, seem to be rather tame and the 
origin of the correlations and structures may be correctly identified. Once 
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the behavior of these phenomena is clearly understood in this model we will 
then attempt to separate what seems to be universal features and what are 
particular features of the model. 



2 Correlations at the synchronization edge 

Consider a globally coupled system of N Bernoulli units with dynamics 

N c 

Xi (t + 1) = (i - c)f( Xi (t)) + £ j^jfixM (i) 

and f(x) = 2x (mod. 1). The nice feature of this globally coupled system is 
that, although each isolated unit is mixing and has orbits of all types, never- 
theless almost everything in the coupled system may be exactly computed. 
This avoids interpretation ambiguities of the results and, hopefully, will allow 
for the separation of universal features from those that are model-dependent 
(see the conclusions). Except for c = c s = |^r- the system is uniformly 
hyperbolic and the Lyapunov exponents are: 

Ai = log 2 

\ = log(2 (l - ^c)) with multiplicity N-1 {) 

For coupling strength c < c s the Lyapunov dimension is N and one ex- 
pects to have a -B-RS'-measure absolutely continuous with respect to the 
Lebesgue measure in R N . This is indeed so, the distribution of the val- 
ues taken by any one unit Xi is essentially flat and, for large N, the mean 
field seen by any one unit has very small fluctuations. However as one ap- 
proaches c = c s from below, one sees that the dynamics organizes itself into 
synchronized patches, with each patch maintaining also an approximately 
constant phase relation with the other patches. The synchronization and 
phase locking effects however are not absolutely stable phenomena, the com- 
position and phases of the clusters changing in time but at a very slow time 
scale. This clustering effects are evident on the statistics of the coordinate 
differences \xi — Xk\ shown in Fig.l, where one has taken the time averages 
over all pairs of units for a 100-units system. Fig.l shows these distributions 
as c varies. In Fig. la, without interaction (c = 0) the triangular form of 
the distribution only reflects the projection along the diagonal of a uniform 
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distribution of the two coordinates on the unit square. As c increases this 
distribution is deformed (Fig. lb, for example) but nothing dramatic occurs 
until one reaches the region near c s = §^rp • Then as shown in Fig.lc, well 
defined structures develop which correspond either to synchronization (peak 
at zero) or to approximate phase locking (peak near 0.5 and bump around 
0.25). Notice however that this figure actually shows the superposition of 
two effects. If instead of taking the average over all distance pairs, one fixes 
a specific pair of coordinates, one may obtain for short periods either the 
two peaks at zero and 0.5 or the bump at 0.25. Finally for c > c s one ob- 
tains global synchronization (Fig. Id). Marked structures are also obtained 
for some other linear combinations of the coordinates. Fig.2a-d shows the 
statistics for Xj + x i+ i — 2x i+2 ■ 

The interpretation of these effects follows nicely from the knowledge of 
the Lyapunov exponents listed in (Q). For c < c s all Lyapunov exponents are 
positive. However, near c s there is one large Lyapunov exponent whereas all 
the others are nearly zero. This implies a fast separation dynamics (sensitive 
dependence to initial conditions) in one direction and very slow separation 
dynamics in all other directions transversal to the fast one. The fast one cor- 
responds to the eigenvector (1, 1 , 1, 1, 1). Therefore, although the invariant 
physical measure is still absolutely continuous with respect to Lebesgue, the 
slow separation dynamics in the transversal directions corresponds to long 
wavelength effects in phase space that are most sensitive to the boundary con- 
ditions and the available phase-space. Then, the slow temporal structures 
beget non-uniform probability distributions in the linear combinations of the 
variables that correspond to the slow eigenvalues. In particular, Xi — 
corresponds to the eigenvector (0, 1, — 1, 0, 0) and X{ + Xi + i — Xi + 2 to 
(0,...,1, 1,-2,0,..., 0). 

In conclusion: the existence of structures near the transition points where 
one or more Lyapunov exponents approach zero from above should be an uni- 
versal phenomena, whereas the detailed form of the structures must depend 
one the particular nature of the available phase-space. The non-universality 
of the shape of the probability distribution is quite apparent in our example. 
.B.RS'-measures are in general obtained from the topological pressure when 
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the function is the sum of the positive Lyapunov exponents, namely fl9 



H^dX) 



lim lim sup ,, E ex P / / 6(X-fY)dtdX 

s^OT^oc s Z[E,T,(f>)g \J-T J 2T J~T 



(3) 

S 1 being a (e, T)— separated subset. If the function (j) is the sum of the posi- 
tive Lyapunov exponents, in our example it only contributes a phase factor, 
constant all over phase-space. Hence, the shape of the invariant measure 
depends only on the delta function, that is on the orbit structure which is 
determined by the boundary conditions and the available phase-space. 

For the coupled Bernoulli units example the shape of the probability 
structures may actually be recovered from an approximate probabilistic equa- 
tion. From ([]]) it follows that for any two units one has the following relation 

N 

x .(t + i) _ Xk (t + !) = (!- ^_ c ) (f(xi(t)) - f(x h (t))) (4) 

However (Ifi does not define a deterministic dynamical law because it has 
two branches in the interval (0,0.5), namely 

/ 2(1-^X^-3*) \ 
Xi - x k -> or if (xi - x k ) < 0.5 (5) 

V (1 - ^c) (1 - 2(xi - x h )) J 

Xi-Xk -> (1 - ^ztc) (2(xj - x k ) - 1) if (Xi - x k ) > 0.5 

Defining r = \xi — Xk\ and assigning probabilities pi, p 2 and p 3 to these 
three branches one may write a probabilistic version of the Perron-Frobenius 
equation 

1 - r yepi(r) f Wi) 1 - Vi 

where the sum runs over the three possible inverses of r and the factors 1 — r 
and 1 — Hi account for the projection along the diagonal on the unit square. 
Iteration of this equation with pi = p 2 = 0.5 and p^ — 1 shows that in the 
neighborhood of j^zjc = 0.5 one obtains the observed structures, namely 
either two peaks at zero and 0.5 or a bump around 0.25. 
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3 Self-organization and the structure index 



In general one calls coherent structure (in a collective system) an identifiable 
phenomenon that has a scale very different from the scale of the components 
of the system. A structure in space will correspond to a feature at a length 
scale larger than the characteristic size of the components and a structure 
in time is a phenomenon with a time scale larger than the cycle time of the 
individual components. This suggests the definition of a (temporal) structure 
index 

1 N s rp rp 

1 = 1 

where N is the total number of components (degrees of freedom) of the cou- 
pled system, N s is the number of structures, Tj is the characteristic time of 
structure i and T is the cycle time of the components (or, alternatively the 
characteristic time of the fastest structure). A similar definition would apply 
for a spatial structure index, by replacing characteristic times by character- 
istic lengths. In our coupled Bernoulli units example the characteristic times 
of the separation dynamics are the inverse of the Lyapunov exponents and 
one obtains 

S = £=k( - 1) for #rc<0.5 

S = for ic>0.5 

For jfz^c > 0.5 the structure index vanishes because the synchronized motion 
is effectively one-dimensional and the characteristic time of the synchronized 
motion coincides with the characteristic time of the individual units. The 
structure index is zero both for the uncoupled case and the fully synchronized 
one and diverges at the synchronization transition. 

In a previous paper |13||, the self-organization that occurs when identical 



dynamical systems are coupled was characterized by ergodic invariants con- 
structed from the conditional exponents. Namely, a measure of dynamical 
self- organization was defined by 

N 

I=J2i h k + h m-k ~ h} (9) 
k=l 
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where h k and /i7v_fc, the conditional exponent entropies associated to the 
splitting R k x R N ~ k , are the sums of the positive conditional exponents 

h k = E ? w >0 d fc) 

7 ^ c (iv-fe) (10) 

n-N-k — l^^N-k) >0 t,i 

the conditional exponents being the eigenvalues of 

lim (D k f n *(x)D k f n (x))& 

n^oo 

where D k f n is the k x k diagonal block of the full Jacobian. 

For the coupled Bernoulli units example, for splittings into 1 and N — 1 
parts, one obtains in the limit of large N 

/ = c< 1 

l-c C ^2 (11) 

This quantity is also peaked at the synchronization point, (although finite) 
but its interpretation is different from the structure index. The Lyapunov 
exponents or the conditional exponents measure the change in the dynamics 
that occurs when one makes a small change in the initial conditions. There- 
fore a system with large exponents has a large freedom to change its future 
state with a small effort at the present time. From this point of view, hj~ 
measures the apparent (from the point of view of unit k) dynamical freedom 
(or rate of information production) of unit k. h^_ k has the same interpre- 
tation for the system composed of the remaining N — 1 units. However it is 
h that defines the actual rate of information production (or dynamical free- 
dom) of the whole system. Therefore J is a measure of the apparent excess 
of dynamical freedom. 



4 Conclusions 



1. When in an interacting multi-unit system the parameters changes and 
one reaches a region where one or more of the positive Lyapunov exponents 
approaches zero, the slow separation dynamics along the direction of the 
corresponding eigenvectors leads to the development of temporal structures, 
but without dimension reduction in phase-space. The structures are expected 
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to be metastable, but with a time scale much larger than the cycle time of the 
individual units. These regions, where the system displays what is perhaps 
its most interesting behavior, are located near the transition disorder-order 
but still on the disorder side. Emergence of structures at the Lyapunov 
exponents transition regions is expected to be an universal phenomenon, but 
the detailed nature of the structures must be model-dependent. 

2. When there is a natural limitation on the range of values that the 
state variable of each individual unit can take, the coupling must be a convex 
coupling like in the Bernoulli units example. Then the convex coupling leads 
to an overall contracting effect and Lyapunov transitions are to be expected 
when the coupling increases. In spatially extended systems, for example, the 
basic interaction law might not change but a change in density implies an 
effective coupling increase. Therefore in a evolving system where the number 
of individuals changes in time (but the available space remains fixed), effects 
of the type described here might be expected to arise when the population 
density changes. 

That at transition regions between chaos and order, evolving systems 
display interesting structured properties had been suggested before by several 
authors ^0 1 [21 . Why some natural systems might have evolved to such 



narrow regions in parameter space is, to a large extent, an open question. The 
density-dependent increase of the effective interaction and the contracting 
effect implied by the convex coupling, when the amount of available phase- 
space remains constant, is a dynamical mechanism that might explain, in 
some cases, the evolution towards the transition regions. 

3. Given an invariant measure for the interacting system, the structure 
index and the measure of self-organization are both well-defined ergodic in- 
variants which characterize different aspects of the collective behavior. They 
provide a first step towards a rigorous ergodic theory of self- organization. 
In this connection it should be mentioned that a dynamical measure is not 
completely characterized by the Lyapunov and the conditional exponents. 
Ruelle, for example, has pointed out that the exponents being obtained as 
limits of averages, the moments of the fluctuations around the average are 
new, independent, ergodic invariants (unless the fluctuations are Gaussian). 
Moments are not always a reliable way to characterize stochastic processes ^] 
but large families of ergodic invariants may be obtained in several other ways, 
for example from a variational formulation of the dynamics p3| . 
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FIGURE CAPTIONS 

Fig.l - Distribution of the variable | X 2 X j I for several values of the cou- 
pling parameter C = jfzjc in a Bernoulli network of 100 units 

Fig. 2 - Distribution of the variable X{ + Xi + i — 2xi + 2 for several values of 
the coupling parameter C = j^zjc in a Bernoulli network of 100 units 
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Fig.1 



